DARPA ATIS Test Results June 1990
نویسندگان
چکیده
Introduction The first Spoken Language System tests to be conducted in the DARPA Air Travel Information System (ATIS) domain took place during the period June 15 20, 1989. This paper presents a brief description of the test protocol, comparator software used for scoring results at NIST, test material selection process, and preliminary tabulation of the scored results for seven SLS systems from five sites: BBN, CMU, MIT/LCS, SRI and Unisys. One system, designated cmu-spi(r) in this paper, made use of digitized speech as input (.wav files), and generated CAS-format answers. Other systems made use of SNOR transcriptions (.snr files) as input.
منابع مشابه
DARPA February 1992 ATIS Benchmark Test Results
This paper documents the third in a series of Benchmark Tests for the DARPA Air Travel Information System (ATIS) common task domain. The first results in this series were reported at the June 1990 Speech and Natural Language Workshop [1], and the second at the February 1991 Speech and Natural Language Workshop [2]. The February 1992 Benchmark Tests include: (1) ATIS domain spontaneous speech re...
متن کاملUsing Semantics to Correct Parser Output for ATIS Utterances
This paper describes the structure and operation of SouL, or SemanticallyOriented Understanding of Language. SouL is a knowledge intensive reasoning system which is opportunistically used to provide a more thorough, fme grained analysis of an input utterance following its processing by a case-frame speech parser. The SOUL postprocessor relies upon extensive semantic and pragmatic knowledge to c...
متن کاملSession 5: Overview of the ATIS System
Two Sessions were devoted to introducing the DARPA SLS Common Task: the Air Travel Information System (ATIS). The first of these (in the late afternoon) provided an overview of the ATIS task and presented a summary of results reported to NIST in the first of a projected series of ATIS benchmark tests, while the second (immediately after dinner) served to describe different approaches in impleme...
متن کاملDARPA Resource Management Benchmark Test Results June 1990
Introduction The June 1990 DARPA Resource Management Benchmark Test makes use of the first of several test sets provided with the Extended Resource Management Speaker-Dependent Corpus (RM2) [I]. The corpus was designed as a speaker-dependent extension to the Resource Management (RM1) Corpus [2], consisting of (only) four speakers, but with a large number (2400) of sentence utterances for each o...
متن کاملDevelopment and Preliminary Evaluation of the MIT ATIS System
This paper represents a status report on the MIT ATIS system. The most significant new achievement is that we now have a speech-input mode. It is based on the MIT SUMMIT system using context independent phone models, and includes a word-pair grammar with perplexity 92 (on the June-90 test set). In addition, we have completely redesigned the back-end component, in order to emphasize portability ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1990